Robert C. Colwell, Reg. No. 27,431 (650) 326-2400 
Applicant: Takeshi Ido, et aL 
Title: Storage Control Apparatus 
Atty Docket No. 16869P-031700 
Sheet 1 of 12 



FIG.1 



,101 



,102 



COMPUTER 



COMPUTER 



103 



COMPUTER 



104 



COMPUTER 



CHANNEL 

Upath 

"201 



CHANNEL 
TPATH 301 

"202 fJ 



, CHANNEL 

Tpath 

"203 



...CHANNEL 

Tpath 

*204 



CHANNEL 



'ORT 



CHANNEL 
PORT 



401 



501 



I/O PROCESS 
CONTROLLER 
(PROCESSOR) 



INDIVIDUAL 
MEMORY 



506 



502 



CHANNEL 
PORT 



M02 

STORAGE CONTROL 
APPARATUS 



I/O PROCESS 
CONTROLLER 
(PROCESSOR) 



INDIVIDUAL 
MEMORY 



07 



CACHE 
MEMORY 



SHARED 
MEMORY 



CHANNEL 
PORT 



403 



503 



I/O PROCESS 
CONTROLLER 
(PROCESSOR) 



505 



510 



INDIVIDUAL 
MEMORY 



'404 



504 



I/O PROCESS 
CONTROLLER 
(PROCESSOR) 



508 



INDIVIDUAL 
MEMORY 



509 




SERVICE 
PROCESSOR 



701 



602 



STORAGE 
DEVICE 




■603 



604 



Robert C. Colweil, Reg. No. 27,431 ( 6 5o) 326-2400 
Applicant: Takeshi Ido, ef a/. 
Title: Storage Control Apparatus 
Atty Docket No. 16869P-031700 
Sheet 2 of 12 



fig.2 



101 



,102 



103 



,104 



COMPUTER 



201 
CHANNEL 
PATH 



COMPUTER 



COMPUTER 



COMPUTER 




I/O PROCESS 

CONTROLLER 

(PROCESSOR) 



INDIVIDUAL 
MEMORY 



506 



I/O PROCESS 
CONTROLLER 
(PROCESSOR) 



INDIVIDUAL 
MEMORY 



507 



CACHE 
MEMORY 



I/O PROCESS 
CONTROLLER 
(PROCESSOR) 



I/O PROCESS 
CONTROLLER 
(PROCESSOR) 



SHARED 
MEMORY 



505 



510 



INDIVIDUAL 
MEMORY 



508 



INDIVIDUAL 
MEMORY 



509 



STORAGE 
DEVICE 



SERVICE 
PROCESSOR 



STORAGE 
DEVICE 



STORAGE 
DEVICE 



601 



602 



-603 



701 



STORAGE 
DEVICE 



604 



Robert C. Colwett, Reg. No. 27,431 (650) 326-2400 
Applicant: Takeshi Ido, et ai 
Title: Storage Control Apparatus 
Atty Docket No. 16869P-031700 
Sheet 3 of 12 



FIG.3 



COMPUTER 



-101 



-201 

CHANNEL 
PATH 



301 



CHANNEL 
PORT 



501 



401 



CHANNEL 
P ORT 



I/O PROCESS 
CONTROLLER 
(PROCESSOR) 



INDIVIDUAL 
MEMORY 



506 



502 



CHANNEL 
PORT 



402 

STORAGE CONTROL 
APPARATUS 



I/O PROCESS 
CONTROLLER 
(PROCESSOR) 



INDIVIDUAL 
MEMORY 



I 



07 



CACHE 
MEMORY 



SHARED 
MEMORY 



CHANNEL 
PORT 



403 



503 



I/O PROCESS 
CONTROLLER 
(PROCESSOR) 



505 



510 



INDIVIDUAL 
MEMORY 



1: 



404 



504 



I/O PROCESS 
CONTROLLER 
(PROCESSOR) 



508 



INDIVIDUAL 
MEMORY 



509 




STORAGE 
DEVICE 




601 



602 



603 



604 




Robert C. Colwell, Reg. No. 27,431 (650) 326 2400 
Applicant: Takeshi Ido, et al. 
Title: Storage Control Apparatus 
Atty Docket No. 16869P-031700 
Sheet 4 of 12 



511 



FIG.4 



CHANNEL PORT INFORMATION 
MANAGEMENT TABLE 

CHANNEL PORT 401 c — 512 



PRIORITY CHANNEL PORT- 
INFORMATION 



PRIORITY CHANNEL PORT 
IDENTIFICATION INFORMATION Pc 



IOPS THRESHOLD 
INFORMATION It 



IOPS PERFORMANCE 
INFORMATION le 



TARGET IOPS INFORMATION lo 




NON-PRIORITY CHANNEL PORT 
NFORMATION 



DELAY SETTING VALUE At 



DELAY TIMER Dt 



IOPS MAXIMUM NUMBER lu 



IOPS MINIMUM NUMBER 



IOPS PERFORMANCE 
INFORMATION le' 



SHARED 
MEMORY 
505 



513 
514 



516 




CHANNEL PORT 402 



PRIORITY CHANNEL PORT 
INFORMATION 



PRIORITY CHANNEL PORT 
IDENTIFICATION INFORMATION Pc 



IOPS THRESHOLD 
INFORMATION It 



IOPS PERFORMANCE 
INFORMATION le 



TARGET IOPS INFORMATION lo 



NON-PRIORITY CHANNEL PORT 
NFORMATION 



DELAY SETTING VALUE At 



DELAY TIMER Dt 



IOPS MAXIMUM NUMBER lu 



IOPS MINIMUM NUMBER I, 



IOPS PERFORMANCE 
INFORMATION le' 



Robert C. ColweU, Reg. No. 27,431 (650 ) 326 2400 
Applicant: Takeshi Ido, et al. 
Title: Storage Control Apparatus 
Atty Docket No. 1 6869P-03 1 700 
Sheet 5 of 12 



FIG.5 



521 



HOST INFORMATION 
MANAGEMENT TABLE 



^522 



COMPUTER 101 



PRIORITY HOST INFORMATION' 



PRIORITY HOST IDENTIFICATION 
INFORMATION Ph 



IOPS THRESHOLD 
INFORMATION It 



IOPS PERFORMANCE 
INFORMATION le 



TARGET IOPS INFORMATION lo 



NON-PRIORITY HOST INFORMATION 



DELAY SETTING VALUE At 



DELAY TIMER Dt 



IOPS MAXIMUM NUMBER lu 



IOPS MINIMUM NUMBER 



IOPS PERFORMANCE 
INFORMATION le' 



^\_^-527 




COMPUTER 102 



PRIORITY HOST INFORMATION 



PRIORITY HOST IDENTIFICATION 
INFORMATION Ph 



IOPS THRESHOLD 
INFORMATION It 



IOPS PERFORMANCE 
INFORMATION le 



TARGET IOPS INFORMATION lo 



NON-PRIORITY HOST INFORMATION 



DELAY SETTING VALUE At 



DELAY TIMER Dt 



IOPS MAXIMUM NUMBER lu 



IOPS MINIMUM NUMBER 



IOPS PERFORMANCE 
INFORMATION le' 



SHARED 

MEMORY 

505 



523 

524 
525 
529 



526 
527 
528 



Robert C Colwell, Reg. No. 27,431 (650) 326-2400 
Applicant: Takeshi Ido, et af. 
Title: Storage Control Apparatus 
Atty Docket No. 16869P-031700 
Sheet 6 of 12 



fig.6 



STORAGE DEVICE INFORMATION 
MANAGEMENT TABLE 

STORAGE DEVICE 601 



532 



PRIORITY STORAGE DEVICE 
INFORMATION 



PRIORITY STORAGE DEVICE 
IDENTIFICATION INFORMATION Pd 



IOPS THRESHOLD 
INFORMATION It 



IOPS PERFORMANCE 
INFORMATION le 



TARGET IOPS INFORMATION lo 




NON-PRIORITY STORAGE DEVICE 
N FORMATION 



DELAY SETTING VALUE At 



DELAY TIMER Dt 




IOPS MAXIMUM NUMBER lu 



IOPS MINIMUM NUMBER I, 



IOPS PERFORMANCE 
INFORMATION le' 



SHARED 
MEMORY 
505 



^533 

'534 

-535 

-539 
536 




STORAGE DEVICE 602 



PRIORITY STORAGE DEVICE 
N FORMATION 



PRIORITY STORAGE DEVICE 
IDENTIFICATION INFORMATION Pd 



IOPS THRESHOLD 
INFORMATION It 



IOPS PERFORMANCE 
INFORMATION le 



TARGET IOPS INFORMATION lo 



NON-PRIORITY STORAGE DEVICE 
NFORMATION 



DELAY SETTING VALUE At 



DELAY TIMER Dt 



IOPS MAXIMUM NUMBER lu 



IOPS MINIMUM NUMBER I, 



IOPS PERFORMANCE 
INFORMATION le' 



Robert C. Colwell, Reg. No. 27,431 &50) 326-2400 
Applicant: Takeshi Ido, et ai 
Title: Storage Control Apparatus 
Atty Docket No. 16869P-031700 
Sheet 7 of 12 



fig.7 



COMMAND START 

CHECK 
(CHANNEL PORT) 



814 



FETCH PRIORITY CHANNEL PORT 
IDENTIFICATION INFORMATION Pc 
(513) FOR ALL CHANNEL PORTS 



801 



N 



IS THE 
CHANNEL PORTA 
.PRIORITY CHANNEL^ 
PORT? 

N 

*ARE OTHER" 
CHANNEL PORTS 
>RIORITY CHANNEL^ 
PORTS? 



802 



803 



FETCH IOPS THRESHOLD 
INFORMATION It (514) FOR 
PRIORITY CHANNEL PORTS 



I 



FETCH IOPS PERFORMANCE le 
(515) FOR PRIORITY CHANNEL 
PORTS 



804 



805 



tJO OTHER 
CHANNEL PORTS 
INCLUDE lt<le? 



806 



810 



812 



FETCH DELAY SETTING 
VALUE D (517) 

— 



807 



FETCH DELAY TIMER 
Dt(518) 



INITIALIZE Dt(518) 
■ 



COMMAND 
PROCESS OK 



808 




809 



811 



UPDATE Dt (51 8) 
I 



COMMAND 
PROCESS NG 

1 <> 

813 



Robert C. Colwell, Reg. No. 27,431 (650) 326-2400 
Applicant: Takeshi Ido, et al. 
Title: Storage Control Apparatus 
Atty Docket No. 16869P-031700 
Sheet 8 of 12 



fig.8 



/'"CO 

^2 



COMMAND START 
CHECK (HOST) 




914 



FETCH PRIORITY HOST 
IDENTIFICATION INFORMATION Ph 
(523) FOR ALL HOSTS 




901 



902 



903 



FETCH IOPS THRESHOLD 
INFORMATION It (524) 
FOR PRIORITY HOSTS 



FETCH IOPS PERFORMANCE 
le (525) FOR PRIORITY HOSTS 



■904 



-905 



DO OTHER 
HOSTS INCLUDE 
lt<le? 

2: 



910 



FETCH DELAY SETTING 
VALUE jdX (527) 



FETCH DELAY TIMER 
Dt (528) 



INITIALIZE Dt (528) 



'906 



907 




911 



UPDATE Dt (528) 



912 


COMMAND 
PROCESS OK 




COMMAND 
PROCESS NG 






< 


1 <> 



(^END^^) 



913 



Robert C. Colwell, Reg. No. 27,431 (650) 326-2400 
Applicant: Takeshi Ido, ef at. 
Title: Storage Control Apparatus 
Atty Docket No. 16869P-031700 
Sheet 9 of 12 



fig.9 



C COMMAND START 
CHECK 
STORAGE DEVICE 



1014 



FETCH PRIORITY STORAGE DEVICE 
IDENTIFICATION INFORMATION Pd 
(533) FOR ALL STORAGE DEVICES 




1001 



,1002 



1003 



FETCH IOPS THRESHOLD 
INFORMATION It (534) FOR 
PRIORITY STORAGE DEVICES 



X 



FETCH IOPS PERFORMANC 
le (535) FOR PRIORITY 
STORAGE DEVICES 



1004 



-1005 



DO OTHER 
STORAGE DEVICES 
INCLUDE lt<le? 



1006 



1010- 
1012- 



FETCH DELAY SETTING 
VALUED (537) 



FETCH DELAY TIMER 
Dt(538) 



/1 007 



/1 008 





_J009 








— 2Ty 




1011 

r r 


/ INITIALIZE Dt (538) 


UPDATE Dt (538) 



I 



COMMAND 
PROCESS OK 



I 



<C en O 



COMMAND 
PROCESS NG 

' e 

1013 



Robert C. Colwell, Reg. No. 27,431 (650 ) 326-2400 
Applicant: Takeshi ldo, et ai 
Title; Storage Control Apparatus 
Atty Docket No. 16869P-031700 
Sheet 10 of 12 



FiG.10 




1105 



COMMAND START 

CHECK 
(CHANNEL PORT) 




COMMAND START 
CHECK (HOST) 



COMMAND START 

CHECK 
(STORAGE DEVICE) 



COMMAND 
PROCESS 



814 



1101 



•914 




1102 



/1014 




1103 



/I104 



► 

(^END^) 



Robert C. Colwell, Reg. No. 27,431 (650) 326-2400 
Applicant: Takeshi Ido, etal. 
Title: Storage Control Apparatus 
Atty Docket No. 16869P-031700 
Sheet 11 of 12 



FIG.11 



I/O PROCESS 
CONTROLLER 501-504 



CTARGETIOPS^ 
.CCWTROL^' 



SERVICE 
PROCESSOR 



701 



FETCH NON-PRIORITY 
CHANNEL PORT 
IOPS MAXIMUM 
NUMBER lu (51A) 



^1111 
<•■■ 



i513 



CALCULATE & 
IMPLEMENT DELAY 
SETTING VALUED 

(517)FROM lu 



1112! 



514 



.r 



515 



STANDARD TIME 
I/O PROCESSING 



1113 



FETCH IOPS 
PERFORMANCE 
INFORMATION (515) 
FETCH TARGET 
IOPS (519) 



FETCH NON-PRIORITY 
CHANNEL PORT 
IOPS MINIMUM 
NUMBER l L (518) 




RESET NON-PRIORITY 
CHANNEL PORT 
DELAY SETTING 
VALUE A. 



XT 
1117 



PRIORITY CHANNEL-^ _ 
PORT INFORMATION L 512 



PRIORITY CHANNEL PORT 
IDENTIFICATION INFORMATION 



IOPS THRESHOLD 
INFORMATION It 



IOPS PERFORMANCE 
INFORMATION le 



TARGET IOPS INFORMATION lo 



519 NON-PRIORITY CHANNEL 
5jA PORT INFORMATION 



1114 
51 B^ 






IOPS MAXIMUM NUMBER lu 


IOPS MINIMUM NUMBER l L 


IOPS PERFORMANCE 
INFORMATION le' 


51 CH 


> 




DELAY SETTING VALUE A. 


<.....; 






s 


X 






517 


1115 






SHARED MEMORY 



505 



^dt=^dt0+a(le-lo)+b X^Oe-loJdt 



a,b: COEFFICIENTS 

^dtO: INITIAL DELAY SETTING 

VALUE 
tO: CONTROL START TIME 
t CURRENT TIME 



Robert C. Colwell, Reg. No. 27,431 ( 650) 32&2400 
Applicant: Takeshi Ido, et al. 
Title: Storage Control Apparatus 
Atty Docket No. 16869P-031700 
Sheet 12 of 12 



FiG.12 



I/O PROCESS 
CONTROLLER 501-504 




IOPS MAXIMUM 
NUMBER CONTROL 




701 



FETCH NON-PRIORITY 
CHANNEL PORT 
IOPS MAXIMUM 
NUMBER III (51 A) 

I 



SERVICE 
PROCESSOR 



[X 
1121 
K- 



CALCULATE & 
IMPLEMENT DELAY 
SETTING VALUER 

(517) FROM lu 



1122= 



STANDARD TIME 
I/O PROCESSING 



I 



IX 
1123 



FETCH IOPS 
PERFORMANCE 
INFORMATION (51 C) 



513 



1124 




RESET NON-PRIORITY 
CHANNEL PORT 
DELAY SETTING 
VALUE Zlt 



X 



1126 



^-PRIORITY CHANNEL 
512 PORT INFORMATION 



PRIORITY CHANNEL 
PORT IDENTIFICATION 
INFORMATION 



IOPS THRESHOLD 
INFORMATION It 



IOPS PERFORMANCE 
INFORMATION le 



NON-PRIORITY CHANNEL 
PORT INFORMATION 



IOPS MAXIMUM 
NUMBER lu 



IOPS PERFORMANCE 
INFORMATION le' 



DELAY SETTING 
VALUER 



SHARED MEMORY 



x 



MONITOR 
-514 

-515 



51 C 
51A 

517 



505 



^lt=^ltO+a(le-lo)+b J ^(le-lojdt 

a,b: COEFFICIENTS 

A®. INITIAL DELAY SETTING 

VALUE 
tO: CONTROL START TIME 
t CURRENT TIME 



